Sonic Gestures as Input in Human-computer Interaction: towards a Systematic Approach
نویسنده
چکیده
While the majority of studies in sonic interaction design (SID) focuses on sound as the output modality of an interactive system, the broad scope of SID includes also the use of sound as an input modality. Sonic gestures can be defined as sound-producing actions generated by a human in order to convey information. Their use as input in computational systems has been studied in several isolated contexts, however a systematic approach to their utility is lacking. In this study, the focus is on general sonic gestures, rather than exclusively focusing on musical ones. Exemplary interactive systems applying sonic gestures are reviewed, and based on previous studies on gesture, the first steps towards a systematic framework of sonic gestures are presented. Here, sonic gestures are studied from the perspectives of typology, morphology, interaction affordances, and mapping. The informational richness of the acoustic properties of sonic gestures is highlighted.
منابع مشابه
Human Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملSonic Gestures and Rhythmic Interaction between the Human and the Computer
Aalto University, P.O. Box 11000, FI-00076 Aalto www.aalto.fi Author Antti Jylhä Name of the doctoral dissertation Sonic Gestures and Rhythmic Interaction between the Human and the Computer Publisher School of Electrical Engineering Unit Department of Signal Processing and Acoustics Series Aalto University publication series DOCTORAL DISSERTATIONS 32/2012 Field of research Acoustics and audio s...
متن کاملProlegomena to sonic toys
A variety of electronic sonic toys is available in the market. However, such toys are usually played by pushing buttons which trigger different sampled sounds. In this paper we advocate the possibility of using continuous natural gestures connected with synthesized sounds for the creation of enactive sonic toys. Keywords— sonic toys, Human-Computer Interaction, Multimodal Interaction
متن کاملGesture Recognition for Human-Computer Interaction (HCI)
Considerable effort has been put towards developing intelligent and natural interfaces between users and computer systems. This is done by means of a variety of modes of information (visual, audio, pen, etc.) either used individually or in combination. The use of gestures as means to convey information is an important part of human communication. The automatic recognition of gestures enriches H...
متن کامل